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We come up with a class of distributed quantized averaging algorithms on asynchronous communi- 
cation networks with fixed, switching and random topologies. The implementation of these algorithms 
is subject to the realistic constraint that the communication rate, the memory capacities of agents and 
the computation precision are finite. The focus of this paper is on the study of the convergence time 
of the proposed quantized averaging algorithms. By appealing to random walks on graphs, we derive 
polynomial bounds on the expected convergence time of the algorithms presented. 



o 

C3 



> ' I. Introduction 



(N 
(N 



O 



>< 



Consider a network of (mobile or immobile) agents. The distributed consensus problem aims 
to design an algorithm that agents can utilize to asymptotically reach an agreement by com- 



(N 

municating with nearest neighbors. This problem historically roots in parallel computation , 



and has attracted significant attention recently ll3l lfT0l[[ T4 | . As a special case of the consensus 
problem, the distributed averaging problem requires that the consensus value be the average of 



individual initial states. The distributed averaging algorithm acts as the building block for many 
distributed tasks such as sensor fusion lfT6l and distributed estimation [fT2|. 

In real-world communication networks, the capacities of communication channels and the 
memory capacities of agents are finite. Furthermore, the computations can only be carried out 
with finite precision. From a practical point of view, real-valued averaging algorithms are not 
feasible and these realistic constraints motivate the problem of average consensus via quantized 
information. Another motivation for distributed quantized averaging is load balancing with 
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indivisible tasks. Prior work on distributed quantized averaging over fixed graphs includes [QQ|, 
[0, 0, rTTTTl . Recently, lfl3l examines quantization effects on distributed averaging algorithms 
over time-varying topologies. As in IfTTTl . we focus on quantized averaging algorithms preserving 
the sum of the state values at each iteration. This setup has the following properties of interest: 
the sum cannot be changed in some situations, such as load balancing; and the constant sum 
leads to a small steady-state error with respect to the average of individual initial states. This 
error is equal to either one quantization step size or zero (when the average of the initial states 
is located at one of the quantization levels) and thus is independent of N. This is in contrast to 
the setup in lfl3l where the sum of the states is not maintained, resulting in a steady-state error 
of the order 0(N 3 log N). 

The convergence time is typically utilized to quantify the performance of distributed averag- 
ing algorithms. The authors in 01, lfT5l study the convergence time of real-valued averaging, 
while 0T1, |[T3l discuss the case of quantized averaging. The polynomial bounds of the expected 
convergence time on fixed complete and linear graphs are derived in ifTTI . Recently, the authors 
in |[T3l give a polynomial bound on the convergence time of a class of quantized averaging 
algorithms over switching topologies. Among the papers aforementioned, flU, lfT3ll . lfT5l require 
global synchronization, and lUTl needs some global information (e.g, a centralized entity or the 
total number of the edges) to explicitly bound the expected convergence times. However, real- 
world communication networks are inherently asynchronous environment and lack of centralized 
coordination. 

Statement of contributions. The present paper proposes a class of distributed quantized aver- 
aging algorithms on asynchronous communication networks with fixed, switching and random 
topologies. The algorithms are shown to asymptotically reach quantized average consensus in 
probability. Furthermore, we utilize meeting times of two random walks on graphs as a unified 
approach to derive polynomial bounds on the expected convergence times of our presented 
algorithms. To the best of our knowledge, this note is the first step toward characterizing 
the expected convergence times of completely distributed quantized averaging algorithms over 
asynchronous communication networks. A preliminary conference version of this paper is in [fTTl 
where the convergence time of synchronous algorithms is also studied. 
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II. Preliminaries and problem statement 

Here, we present the problem formulation along with some notation and terminology. 

Asynchronous time model. In this note, we will employ the asynchronous time model proposed 
in flU. More precisely, consider a network of N nodes, labeled 1 through N. Each node 
has a clock which ticks according to a rate 1 Poisson process. Hence, the inter-tick times at 
each node are random variables with rate 1 exponential distribution, independent across nodes 
and independent over time. By the superposition theorem for Poisson processes, this setup is 
equivalent to a single global clock modeled as a rate N Poisson process ticking at times {Zk}k>o- 
By the orderliness property of Poisson processes, the clock ticks do not occur simultaneously. 
The inter-agent communication and the update of consensus states only occur at {Z fc } fc > . In the 
reminder of this paper, the time instant t will be discretized according to {Zk}k>o and defined 
in terms of the number of clock ticks. 

Network model. We will employ the undirected graph Q{t) = (V, E(t)) to model the network. 
Here V :— {1, • • • , N} is the vertex set, and an edge (j, i) £ E(t) if and only if node j can 
receive the message from node i (e.g., node j is within the communication range of node i) at time 
t. The neighbors of node i at time t are denoted by Mi{t) = {j £ V \ £ E(t) and j ^ i}. 
The state of node i at time t is denoted by Xi(t) £ R and the network state is denoted by 
x(t) = (xi (£),••• ,£7v(t)) T . Suppose the initial states £j(0) £ [U m i n ,U max ] for all i £ V and 
some real numbers U min and U m3iX . 

Quantization scheme. Let R denote the number of bits per sample. The total number of 
quantization levels can be represented by L = 2 R and the step size is A = (U max — U m i n )/2 R . 
The set of quantization levels, {ui, ■ ■ ■ is a strictly increasing sequence in M. and the 

levels are uniformly spaced in the sense that u i+i — tUi = A. A quantizer Q : [U min , U max ] — > 
{u\, ■ ■ ■ , ujl] is adopted to quantize the message u £ [U min , f/ max ] in such a way that Q(u) = Ui 
if u £ [ui, u; i+ i) for some i £ {1, • • • , L — 1}. Assume that the initial states Xj(0) for alH £ V 
are multiples of A. 

Problem statement. The problem of interest in this paper is to design distributed averaging 
algorithms which the nodes can utilize to update their states by communicating with neighbors 
via quantized messages in an asynchronous setting. Ultimately, quantized average consensus 
is reached in probability; i.e., for any initial state x(0), there holds that lim t -+ 00 ¥(x(t) £ 
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W(x(0))) = 1. The set W(x(0)) is dependent on initial state x(0) G M. N and defined as 
follows. If x(0) = jfJ2?=x x i( Q ) is not a multiple of A, then W(x(0)) = {x G R N | x { G 
{Q(x(0)), Q(5(0)) + A}}; otherwise, W(x(0)) = {i G i w | x« = x(0)}. Now it is clear that 
the steady-state error is at most A after quantized average consensus is reached. 

Notions of random walks on graphs. In this paper, random walks on graphs play an important 
role in characterizing the convergence properties of our quantized averaging algorithms. The 
following definitions are generalized from those defined for fixed graphs in Q, (SJ. 

Definition 2.1 (Random walks): A random walk on the graph Q(t) under the transition 
matrix P(t) = (pij(t)), starting from node v at time s, is a stochastic process {X(t)} t > s such 
that X(s) = v and F(X(t + 1) = j | X{t) = i) = Pij(t). A random walk is said to be simple if 
for any i G V, Pu(t) = for all t > 0; otherwise, it is said to be natural. • 

Definition 2.2 (Hitting time): Consider a random walk on the graph Q(t), beginning from 
node i at time s and evolving under the transition matrix P(t). The hitting time from node i to the 
set A C V, denoted as H^( t \ P f t \ s \(i, A), is the expected time it takes this random walk to reach 
the set A for the first time. We denote H(g( t ),P{t)) (A) = sup s>0 maxj e y ^(e(t),p(i),s)(i, A) as the 
hitting time to reach the set A. The hitting time of the pair i, j, denoted as H(g( t ),p(t),s) {i, j), is the 
expected time it takes this random walk to reach node j for the first time. Denote H^g^^p^ = 
sup s>0 maxjjgy H(g(t),p{t), s ){h j) as the hitting time of going between any pair of nodes. • 

Definition 2.3 (Meeting time): Consider two random walks on the graph Q(t) under the 
transition matrix P(t), starting at time s from node i and node j respectively. The meeting 
time M(g(t),p(t), s )(hj) of these two random walks is the expected time it takes them to meet at 
some node for the first time. The meeting time on the graph Q(t) is defined as A%/(t),p(t)) = 
sup s > maxjjev M { g {t)tP(t)tS) • 

For the ease of notation, we will drop the subscript s in the hitting time and meeting time 
notions for fixed graphs. The following notion is only defined for fixed graphs. 

Definition 2.4 (Irreducibility and reversibility): A random walk on the graph Q is irre- 
ducible if it is possible to get to any other node from any node. An irreducible random walk 
with stationary distribution n is called reversible if iTiPij = ftjPji for all i,j G V. • 

Notations. For a G R, define V a : R N -»■ R as V a {x) = E 4 =i(^-«) 2 - We define J : rN ~> R 
as J(x) = (maxjgy Xj — min ig y Xj)/A. Denote the set = {(k, k) \ k G V}. The distribution 
of a vector x G M N is defined to be the list {(qi, mi), (q2, m^), ■ ■ ■ , (qk, n^k)} for some k G V 



February 10, 2010 



DRAFT 



5 



where Y^e.=i' m t = N, q- for i ^ j and mg is the cardinality of the set {i E V \ Xi = q t } . 
The cardinality of the set M is denoted by \M\. 

III. Asynchronous distributed quantized averaging on fixed graphs 

In this section, we propose and analyze an asynchronous distributed quantized averaging 
algorithm on the fixed and connected graph Q. Main references are ifTTI on quantized gossip 
algorithms and B21 on the meeting time of two simple random walks on fixed graphs. 

A. Proposed algorithm 

The asynchronous distributed quantized averaging algorithm on the fixed and connected graph 
Q (AF, for short) is described as follows. Suppose node i's clock ticks at time t. Node i randomly 
chooses one of its neighbors, say node j, with equal probability. Node i and j then execute the 
following local computation. If Xi(t) > Xj(t), then 

Xi(t + 1) =Xi{t)-6, x j (t + l) = x j (t) + 5; (1) 

otherwise, 

Xi(t+ 1) = Xi(t) + 5, Xj(t+1) =Xj(t)-6, (2) 

where 5 = \{xi(t) — Xj(t)) if gli^h^jW i s an integer; otherwise, 5 = Q(\(xi(t) — Xj(t))) + A. 
Every other node k E V \ {i,j} preserves its current state; i.e., Xk(t + 1) = Xk(t). 

Remark 3.1: The precision ^ is sufficient for the computation of 5 and thus the update laws 
CQ) and ©. It is easy to verify that Xi(t) G [U m - m , U max ] and Xi(t) are multiples of A for all 
i E V and t > 0. Furthermore, the sum of the state values is preserved at each iteration. 

If \xi(t) — Xj(t)\ = A, the update laws ((U) and © become Xi(t + 1) = Xj(t) and Xj(t + 1) = 
Xi(t). Such update is referred to as a trivial average in 0TJ. If \xi(t) — Xj(t)\ > A, then ([!]) or 
© is referred to as a non-trivial average. Although it does not directly contribute to reaching 
quantized average consensus, trivial average helps the information flow over the network. • 

B. The meeting time of two natural random walks on the fixed graph Q 

To analyze the convergence properties of AF, we first study a variation of the problem in j8]|, 
namely, the meeting time of two natural random walks on the fixed graph Q. More precisely, 
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assume that the fixed graph Q be undirected and connected. Initially, two tokens are placed on 
the graph Q; at each time, one of the tokens is chosen with probability i and the chosen token 
moves to one of the neighboring nodes with equal probability. What is the meeting time for 
these two tokens? 

The tokens move as two natural random walks with the transition matrix Paf on the graph Q. 
The matrix P AF = (p%) <G R NxN is given by p« = 1 - ^ for % G V, p y = for G E. 
The meeting time of these two natural random walks is denoted as M(g 7 p AF ). Denote any of 
these two natural random walks as X^-. Correspondingly, we construct a simple random walk, 
say Xs, with the transition matrix Psf on the graph Q where the matrix Psf = (Pij) £ M 7Vx7V 
is given by pa = and ptj = t^t if G E. The hitting times of the random walks X s and 
X^f are denoted as i?(g,p SP ) and H(g t p AF ), respectively. 

Proposition 3.1: The meeting time of two natural random walks with transition matrices Paf 
on the fixed graph Q satisfies that M(g i p AF ) < 2NH(g t p SF ) — N. 

Proof: Since the fixed graph Q is undirected and connected, the random walks X^ and X s 
are irreducible. The reminder of the proof is based on the following claims: 

(i) It holds that H [g ^ AF) > N. 

(ii) For any pair i, j eV with i ^ j, we have H { g t p AF) (i, j) = NH { g jPsF) (i,j). 

(iii) For any i, j, k G V, the following equality holds: 

H (G,PAF)(hj) + H { g,p AF )(j, k) + H { g t p AF) (k, i) = H {g ^ AF) (i, k) + H { g t p AF) (k, j) + £%p AF )(j, i). 

(iv) There holds that M {Q}Paf) < 2H { g t p AF) - N. 
Now, let us prove each of the above claims. 

(i) The quantity P(g p AF )(z, j) reaches the minimum when Mi = {j}. We now consider the 
graph Q with Mi = {j} and compute H^g t p AF )(i, j). The probability that X^ stays up with node 
% before time i and moves to node j at time i is -^(1 — j^Y~ l . Then, we have f/"(g j p AF )(i, j) = 

ES^ 1 - JiY~ l = N and Claim (i) holds - 

(ii) For any pair i,j eV with i ^ j, it holds that %,p af) («, j) = £ fceM N^-\( H (g,P AF )( k J)+ 
1 )+( 1 - A 7)(^(S,Paf)(^j)+ 1 )- Hence, wehavethatif (g ,p AF )(i, j) = iV+£ fcgA/ - ]fc[ H (.e,PAx)( k >j)- 
Furthermore, H (g>PsF) (i,j) = T, k eM i W-\( H (S,P aF )( k >j) + 1 ) = 1 + EfceM ]^\ H (Q,P^)( k J)' 
Hence, Claim (ii) holds. 

(iii) Denote by 7T, = \Mi\/M m . AX and vr = (m, • • • , n N ) T where A/" max = max ieV {\Mi\}. Since 
Paf 71 " = 7r, then 7r is the stationary distribution of the random walk Xj\f. Furthermore, for any 
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pair i,j e V, we have tt^- = ^ N{Kl = ^ 



A/max JV|7V}| 



and thus the random 



walk X^- is reversible. From Lemma 2 of (HI it follows that Claim (iii) holds. 

(iv) Claim (iv) is an extension of Theorem 2 in (S). An immediate result of Claim (iii) gives 
a node-relation on V; i.e., i < j if and only if #(g,p AP )(«, j) < -^(5,Paf)Cm)- This relation is 
transitive and constitutes a pre-order on V. Then there exists a node u satisfying Hrg >PAF \(v, u) > 
H(G,Paf)( u i v ) f° r an y other node v G V. Such a node w is called hidden. As in (81, we define 
a potential function $ by $(z, j) = i%p AF )(«, j) + i%p AF ) (j, «) - H {g ^ AF) (u, j). 

Define the functions $(z, j) and Mrg t p AF \(i,j) below, the averages of the functions $ and 
M(g,p AF ) over the neighbors of node z and j, respectively: 



In Claim (ii), we have shown that H [g ^ AF) (i, j) = £ fceM jfaH(g, PAJf )(k, j) + N. Thus, 
m j) + N = $(z\ j). Similarly, A%p af) (z, j) + JV = M { g t p AF) {i,j). 



Assume that © does not hold. Let be = ma,x W:VeV (M(g t p AF ) (w, v) — $>{w,v)) > 0. Choose 
a pair of i,j with minimum distance among the set E = {(w,v) £ V x V \ M(g t p AF )(w,v) — 
&(w,v) = (j)}. Toward this end, consider the following two cases: 

(1) j G Mi. Observe that = i%p AF ) (i, j) + H { g t p AF) (j,u) - H {g> p AF) (u, j) > = 
m (G,Paf)U'J)- We have ®(h j) + <P> M ( g iPAF) (i,j) and thus 

M { g !PAF) (i,j) = +<P = N + j) + > N + M { g t p AF) (i,j) = M { g jPAF) (i,j). (4) 

(2) j ^ Mi. There exists node k £ Mi such that node fc is closer to node j than node i. Since 
the pair of i,j has the minimum distance in the set S, we have Mrg t p AF \(k,j) — ®(k,j) < 0. 
Hence, $(z, j) + > A% ; p af )(I, j), and thus © holds. 

In both cases, we get to the contradiction M(g : p AF )(i, j) > M(g p AF )(z, j), and thus © holds. 
Combining Claims (i), (ii) and inequality © gives the desired result of M(g > p AF ) < 2iV7?(g ; p SP ) — 
N. U 




We are now in a position to show that for any pair z, j G V, it holds that 



M { g >PAJf) (i,j)<$(i,j). 



(3) 
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C. Convergence analysis of AF 

We now proceed to analyze the convergence properties of AF. The convergence time of AF 
is a random variable defined as follows: T con (x(0)) = inf{£ | x(t) E W(x(0))}, where x(t) 
starts from x(0) and evolves under AF. Choose Vx(o)(x) = J2iLi( x i ~ x(0)) 2 as a Lyapunov 
function candidate for AF. One can readily see that V x ( )(x(t + 1)) = V^(o)(£(t)) when a trivial 
average occurs and V x {q){x) reduces at least 2 A 2 when a non-trivial average occurs. Hence, 
\4(o)(x) is non-increasing along the trajectories, and the number of non-trivial averages is at 
most ^T4( )(x(0)). Define the set ^ = {x E R N | the distribution of x is {(0, 1), (A, N - 
2),(2A,1)}} and denote E[T$] = max x ( ) G * E[T con (a;(0))]. It is clear that the expected time 
between any two consecutive non-trivial averages is not larger than E[T<&]. Then we have the 
following estimates on E[T con (x(0))]: 

E[T con (x(0))] < ^V m (x(0))E[T 9 ] < NJ{X 8 m2 E[T*], (5) 

where the second inequality is a direct result of Lemma 4 in IfTTTl . 

Theorem 3.1: For any x(0) ^ W(x(0)), the expected convergence time E[T con (x(0))] of AF 
is upper bounded by n2j ^°)) 2 (JLn 3 - 1). 

Proof: By ©, it suffices to bound E[T#]. Assume that x(0) E ^. Before they meet for the 
first time, the values and 2A move as two natural random walks which are identical to Xj^ in 
Proposition [3J] At their meeting for the first time, the values of and 2 A average and quantized 
average consensus is reached. Hence, E[T#] = M( 5i p AF ) and thus inequality © becomes 

KPU.(0»] < ^f^M (e , P „, < Mp,^ _ N) , (6) 

where we use Proposition 13. II in the second inequality. By letting M = in the theorem of Page 
265 in 0, we can obtain the upper bound ^A 3 on i?(g,p SF ). Substituting this upper bound into 
inequality © gives the desired upper bound on E[T con (a:(0))]. ■ 
Theorem 3.2: Let x(0) E M N and suppose x(0) ^ W(x(0)). Under AF, almost any evolution 
x(t) starting from x(0) reaches quantized average consensus. 

Proof: Denote T = — J ^°^ (J^A 3 — 1), and consider the first T clock ticks of evolution 
of AF starting from x(0). It follows from Markov's inequality that 

P(T con (x(0)) > f | x(0) i W(x(0))) < E[Tcon ^ (Q))] < i 
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that is, the probability that after T clock ticks AF has not reached quantized average consensus 
is less than |. Starting from x(T), let us consider the posterior evolution of x(t) in the next T 
clock ticks. We have 

P(T con (x(f )) > f | x(f) i W(s(0))) < E[Tcon ^ (r))] < \. 

That is, the probability that after 2T clock ticks x(t) has not reached quantized average consensus 
is at most (|) 2 . By induction, it follows that after nT clock ticks the probability x(t) not reaching 
quantized average consensus is at most (|) n . Since the set W(x(0)) is absorbing, we have 
lim t ^ 00 P(x(t) <£ W(x(0))) = 0. This completes the proof. ■ 

IV. Asynchronous distributed quantized averaging on switching graphs 

We now turn our attention to the more challenging scenario where the communication graphs 
are undirected but dynamically changing. We will propose and analyze an asynchronous dis- 
tributed quantized averaging algorithm on switching graphs (AS, for short). The convergence 
rate of distributed real- valued averaging algorithms on switching graphs in |[l"3l will be employed 
to characterize the hitting time of random walks on switching graphs. 



A. Proposed algorithm 

The main steps of AS can be summarized as follows. At time t, let node i's clock tick. 
If |A/i(t)| 7^ 0, node i randomly chooses one of its neighbors, say node j, with probability 
max{\ss-(t)\ \Af-(t)\y Then, node % and j execute the computation ©or © and every other node 
k E V\{i,j} preserves its current state. If = 0, all the nodes do nothing at this time. 

Here, we assume that the communication graph Q (t) be undirected and satisfies the following 
connectivity assumption also used in J3), [TTOTl . lfl"3l . tfT5l . 

Assumption 4.1 (Periodical connectivity): There exists some B e N >0 such that, for all 
t > 0, the undirected graph (V, E(t) U E(t + 1) U • • • U E(t + B - 1)) is connected. 

Remark 4.1: In the AS, the probability that node % chooses a neighbor j is mSLX ^(l^ |A/"-(t)|} ' 
Thus, this information should be available to node i. In this way, the matrix Pas(^) defined later 
is symmetric and double stochastic. • 
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B. The meeting time of two natural random walks on the time-varying graph Q(t) 

Before analyzing AS, we consider the following problem which generalizes the problem in 
Section UlI-BI to the case of dynamically changing graphs. 

The meeting time of two natural random walks on the time-varying graph Q(t). Assume that 
Q{t) be undirected and satisfies Assumption 14. 1[ Initially, two tokens are placed on Q(0). At 
each time, one of the tokens is chosen with probability -k. The chosen token at some node, say 
i, moves to one of the neighbors, say node j, with probability ^^^^^.^ if \Mi{t)\ ^0; 
otherwise, it will stay up with node i. What is the meeting time for these two tokens? 

Clearly, the movements of two tokens are two natural random walks, say X± and X 2 , on 
the switching graph Q(t). Their meeting time is denoted as M/g(t),p AS (t)) where the transition 
matrix P AS (t) = (Pij(t)) is given as follows: if \Mi(t)\ ^ 0, then p^t) = Nmax{[U ^ t)m . m for 

G E(t) and puit) = 1 - E(i, j)& E(t) jVmax{|MWI,I^WI} ; if |A/ " i(t)l = °' then Pii ® = L 0ne 
can easily verify that the matrix Pas(^) is symmetric and doubly stochastic. The natural random 
walks Xi and X 2 on the graph Q{t) are equivalent to a single natural random walk, say X M , 
on the product graph Q(t) x Q(t). That is, Xm moving from node (11,12) E V x V to node 
(jiih) E V x V on the graph Q(t) x Q(t) at time t, is equivalent to X\ moving from %\ to ji 
and X 2 moving from i 2 to j 2 on the graph Q(t) at time t. Denote the transition matrix of the 
random walk X M as Q(t) = (q^i^^j^t)) G IR^ 2 ''^ 2 . 

In the following lemma, we will consider the random walk Xm on the graph Q(t) x Q(t) 
with the absorbing set and the transition matrix Q(t) G M n2xn2 . Denote e^ lt £ 2 ) by the 
row corresponding to (£i,£ 2 ) G V x V in a A^ 2 x A 2 identity matrix. The transition matrix 
Q(t) is defined by replacing the row associated with the absorbing state (£i,£ 2 ) G 6 in Q(t) 
with e {W . Define $ {hM (t) = ¥(X M (t) = (£i,£ 2 )), #(t) = co\{# (il>h) (t)} G R N \ # e (t) = 
J2 (4 ^ 2 ) 68^(^1 A) W for tne random walk X M , and fi^t^t) = F(X M (t) = (£±,£2)), $(t) = 
col{^ ei/2) (t)}eR N \Mt) = E i e 1 . ,£ 2 ) 6 e ti(h,e2)(t) f° r me random walk X M . 

Lemma 4.1: Consider a network of A nodes whose communication graph Q(t) be undirected 
and satisfies Assumption 14.11 Let (ii, i 2 ) G V x V be a given node and suppose that the random 
walks Xm and X M start from node (ii,i 2 ) at time 0. Then it holds that 1^0 (t) > $e(t) > ^ 
for t > ti where ti is the smallest integer which is larger than 5(8A 6 log(v / 2A) + 1). 

Proof: It is not difficult to check that Q(t) x Q(t) is undirected and satisfies Assumption 14. II 



February 10, 2010 



DRAFT 



1 1 



with period B. The minimum of nonzero entries in Q(t) is lower bounded by jV ^_ 1 ) , and Q(t) 
is symmetric. Observe that for any (i u i 2 ) G V x V and any t > 0, E(jij 2 )evxv ^i^JO'ij^W = 
T.Qj^evxvPiihi^hit) = J2 n ev PiihW x Ej 2 ev^2i 2 (0 = 1 where we use the fact that 
the matrix Pas(^) is doubly stochastic. Hence, the matrix Q{t) is doubly stochastic. 

The evolution of "d(t) is governed by the equation $(t + 1) = Q T (t)'d(t) with initial state 
0(0) = ef iii2) . Consider the Lyapunov function K^(tf) = EE(^ ~ wf witn V ^W)) = 
72. It follows from Lemma 5 in [13] that 



N 2 



V^(m + 1)5)) < (1 - N _ v )V^(#(kB)) (7) 



for /c G N . Denote 1 G K^ 2 as the vector of iV 2 ones and note that 

f£ W*)) " ^ W + ^ = W*) - ^ 1)T(/ " CWQ^W) - ^!)- 
Since Q(t) is doubly stochastic, so is Q(t)Q T (t). Hence, the diagonal entries of the matrix 
r(t) = / - Q(t)Q T (t) = (rfij(t)) G R^x^ 2 are dominant in the sense of y u (t) = E^TuW- 
According to Gershgorin theorem in [[91, all eigenvalues of T(t) lie in a closed disk centered 
at maxjgj! ... TV 2 } 7m(^) with a radius max^x ... >A r2} 7n(t). Hence, r(i) is positive semi-definite. 
Consequently, Ki ($(£)) — Vi + 1)) > and thus V i ($(£)) is non-increasing along the 

N 2 N 2 N 2 

trajectory of $(t). Combining © with the non-increasing property of V i ($(£)) gives that 

1 J\T2 1 1 

Vi (&(t)) < Vi (tf(0))(l = (1 1^" 1 . (8) 

^WW-V^W 2AT5(A^-l) j iV 2 1 2iV 5 (iV-l) ; W 

Since $(t) T l = 1, then $ min (t) := mm {h j 2)eVxV $ {ei/2) (t) < Since Vi (#(*)) > 

(^min(t) - tvt) 2 , inequality ® gives that ?? min (t) > ^ - (^(1 - 2N 5^ N _ 1) )^~ 1 )^ Therefore, 

it holds that ^ min (t) > ^ for t > B{ IgiM gg^ lL + i). since logz < z - 1, there holds 

S( - 2JV 5 (JV-1) ' 

1 



i r < 2N 5 (N-1) < 2N 6 . Hence, we have that $ min (t) > ^2 and thus 7? e (i) > ^ 

for t > h. 

Note that the evolution of $(t) is governed by the equation $(t + 1) = Q(t) T, d(t) with 
$(0) = e( ilji2 ). Since the set 6 is absorbing, > $e(t) for alH > and thus the desired 

result follows. ■ 

Proposition 4.1: The meeting time of two natural random walks with transition matrix Pas(£) 
on the time- varying graph Q(t) satisfies that -&%(t),PAs(*)) ^ 47V£i. 

Proof: Denote by -f^(e(t)xg(t),Q(t))(Q) the hitting time of the random walk X M to reach 
the set of 0. Observe that M (g(t ) i p As(t)) = i%(t)xS(t),Q(t))(®)- To And an u PP er bound on 
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H(g(t)xg(t),Q(t))(®)> we construct the random walk X^' 12 ^ in such a way that starts 
from (ii, i 2 ) at time with i\ ^ i 2 and the set is the absorbing set of X]j£ . The transition 
matrix of X^' i2) is Q(t) defined before Lemma Q Define tfJ^U*) = P(^M' i2) (>) = (4,4)). 
and ^'^(t) = co\{dfl^ ) {t)} e M^ 2 . The dynamics of ^-^(t) is given by tf^ 2 )(t + 1) = 
g(f) r 7?(*i»*a)(t) with the initial state 0(*i'*»>(O) = e£ ^ 

Define the function /ij^g : N -> {0, 1} in such a way that /ij^g = 1 if XjJ' i2) (t) = (£ h £ 2 ); 
otherwise, ^^(t) = 0. Define = Ylt=o $lxtl) ( r ) which is the total times that the 

random walk X^' %2) is at node Then, the hitting time #(g(t)xg(t),Q(t),o)((*i> ^2), ©) of 

X^ 1 ' 12 ^ equals the expected time that Xj^ stays up with the nodes in V x V\Q, that is, 

+00 

%(«)x«( t ),o W ,o)((<i,< 3 ),e)= ^ e [^a)]= E E E^:S( r )] 

+00 +00 

= E E E ^,g(^ = E E w 

It follows from Lemmagjjthat 0£ 1,<a) (t) > ^ far t > *i. With that, the fact of ^( il - i2 )(t) T l = 
1 implies that 

For each (/c 1; fc 2 ) ^ O, we construct the random walk X^ 1 '^ in such a way that X^ 1 ^' 2 ) starts 
from (ki, k 2 ) at time t\ and the set is the absorbing set of X^ 1,k2 \ The transition matrix of 
X ( m M) is Q(t). Define 0$j$(t) = P(x£ 1,fe2) (t) = (4,4))- Following the forgoing arguments 
for Xm 2 \ we have 



£ ^«( 2il )<i-^. (in 

i,fe)0 

Combining (flOl) and (ITT]) gives that 



2iV' 



E *$&w = E E <*S,(*i)^(2*i) 
= E <fi(*o E Cws('-^ ! < 12 > 



By induction, we have ^ e ^^U^i) < (1 — an d then obtain a strictly decreasing 

,q(»1:»2) ( 



sequence £ 2 )^ e '^ 2 2 )(^i) with respect to n G Z . Since the set 9 is absorbing, then 
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^(<i4)^^(?itr) * s non-increasing w i m respect to t > 0. Therefore, we have the following 
estimate 

Substituting CLl]> into © gives that 

+00 

%(t)xfl W ,Q(*),o)((<i,i2),e) < £(i - ^v)^" 1 = (i - 07v rir ' — ; TTx- (1 4 ) 

r=0 1 — C 1 — 2iv) ^ 

1 — — — 

Since t\ > 1, it holds that (1 — ^) *i < 2*i < 2. It follows from Bernoulli's inequality that 
( 1 ~~ 2^)** - 1 ~~ 2WT' and mus ~ ~ - ^ Nt i- Inequality (HU) becomes 

^"(g(t)xg(t),Q(t),0)((«l,«2),©) < 4iVti. (15) 

Actually, inequality (fl"5l) holds for any starting time, any starting node (21,22). Thus it holds 
that M (g(f)i p As(f)) = H { g it)x g {t)t Q (t )^(Q) < ANti. This completes the proof. ■ 



C. Convergence analysis of AS 

We are now in the position to characterize the convergence properties of AS. The quantities 
T con (x(0)) and for AS are defined in a similar way to those in Section Hill 

Theorem 4.1: Let x(0) e R N and suppose x(0) W(x(0)). Assume that Q(t) be undirected 
and satisfies Assumption 14.11 Under AS, almost any evolution x(t) starting from x(0) reaches 
quantized average consensus. Furthermore, E[T con (x(0))] < \B J(x(0)) 2 A 2 (16A 7 + 1). 

Proof: Note that inequality © also hold for AS. Similar to Theorem |3. 11 we have E[T#] = 
Mfgu),p AS (t))- Then, the following estimate on E[T con (x(0))] holds: 

E[T con (x(0))] < NJi l m2 M m , PAs(t)) . (16) 

Substituting the upper bound on M^gr t \p AS r t \^ in Propo sition 14 . 1 1 into ([TBI) and using log(V2iV) < 
2N gives the desired upper bound on E[T con (x(0))] of AS. The reminder of the proof on the 
convergence to quantized average consensus is analogous to Theorem 13.21 and thus omitted. ■ 
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V. Discussion 

A. Asynchronous distributed quantized averaging on random graphs 

Random graphs have been widely used to model real-world networks such as Internet, trans- 
portation networks, communication networks, biological networks and social networks. The 
Erdos - Renyi model Q (N, p) is the most commonly studied one, and constructed by randomly 
placing an edge between any two of N nodes with probability p. 

For any given time, the probability that the (directed) edge is selected is 
Po '■= jf Em=o ^I^N-2P m (^ — p) N ~ 2 ~ m , that is, node i is active, the edge with other 
m E {0, • • ■ , N — 2} edges connecting node i are placed, and the edge is selected by node i. 
To study the convergence properties of AF on Q(N,p), it is equivalent to study AF on complete 
graphs with the transition matrix Par = (Pij) E M. NxN where p^ = po and pa = 1 — (N — l)po. 
The meeting time is denoted as ^^(jv^Par)- The probability that the two tokens meet for the 
first time at time t is 2p , that is, one of the tokens is chosen and simultaneously the edge between 
the two tokens is chosen. Hence, we have ^(g(A r , P ),p AR ) = 2~2i=i ^2po(l — 2p ) £_1 = 

Observe that p = £ £ m =o ^C^p^l-p)^^ > J ^ ) ^ N m ^C^_ 2 p m {l-p) N ^- m = 
j^-y Like Theorem HU we have E[T con (x(0))] < «E[T,] = Wml M{ g {N , p)>PAR) = 

NJ(x(0)) 2 < N 2 {N-l)J{x{0)) 2 
IGpo — 32p 

B. Discussion on the bounds obtained 

Consider a fixed graph with vertices consists of a clique on m vertices, including vertex 
i, and a path of length N — m with one end connected to one vertex k ^ i of the clique, and the 
other end of the path being j. It was shown in [|5l that H^o iPsf ^ is 0(N 3 ) where m = [ 2jV 3 +1 j. 
Let us consider the case that the algorithm AF is implemented on the graph L r £° and initial states 
Xi{0) = 0, Xj{0) = 2 and x k {0) = 1 for all k ^ Observe that E[T con (x(0))] = M (l -o iPaf) . 
From Proposition [3T1 we have that E[T con (x(0))] is 0(A 4 ), that is one order less than the bound 
in Theorem 13.11 

Consider switching graphs Q(t) where Q(t) is the graph L™° defined above when t is a multiple 
of B; otherwise, all the vertices in Q{t) are isolated. Random walks on Q(t) can be viewed as 
time-scaled versions of those on L^°, that is, random walks on Q(t) only make the movements 
when t is a multiple of B. Let us consider the case that the algorithm AS is implemented on the 
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graph and initial states 3^(0) = 0, Xj(0) = 2 and x k (0) = 1 for all k ^ Following the 
same lines above, we have that the bound on E[T con (x(0))] is 0{BN^) which is iV 4 log A^-order 
less than that in Theorem 13.21 

It can be directly computed that i7(g com ,p SF ) is 0(N 2 ) where Q com is a complete graph with N 
vertices. Following the same lines in Theorem 13.11 we have that E[T con (x(0))] is 0(N 3 ) when 
the algorithm AF is implemented on the graph Q com - It implies that the convergence of AF on 
Qcom is as fast as that on Q (A, p) when p is independent of N. This is consistent with the fact 
that the underlining graph of Q(N,p) is Q com . 
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